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ABSTRACT 

—  The  importance  of  appropriate  stochastic  models  in  choosing  efficient 
methods  of  statistical  analysis  is  discussed.  The  fitting  to  data  of 
Seasonal  Autoregressive  Moving  Average  models  is  described  and  it  is  shown 
how  trend  may  be  estimated  in  an  appropriate  class  of  models  of  this  kind. 
The  procedure  is  illustrated  for  a  model  fitted  to  a  money  supply  series 
published  by  the  Federal  Reserve  Board.  Error  limits  are  calculated. 

In  a  series  of  Appendices  the  properties  of  the  adaptive  coefficients 
which  determine  the  trend  estimates  are  derived. 
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SIGNIFICANCE  AND  EXPLANATION 


Seasonal  fluctuations  in  time  series  often  obscure  information  about 
trend.  Thus  it  may  be  known  that  recruitment  for  the  Army  regularly 
decreases  in  certain  months  of  the  year  and  therefore  that  reductions  in 
these  months  are  not  to  be  regarded  as  indicating  any  real  change  in  the 
recruitment  situation.  Historically  problems  of  this  kind  have  been 
dealt  with  by  making  "seasonal  adjustments”  but  the  manner  in  which  these 
adjustments  were  made  has  been  somewhat  arbitrary  is  occasionally 
misleading. 

It  is  argued  in  this  paper  that  the  problem  can  best  be  dealt  with 
not  by  seasonal  adjustment  at  all  but  by  direct  estimation  of  the  current 
trend  using  an  appropriate  stochastic  model  which  has  been  fitted  to  the 
series.  The  method  has  the  advantage  that,  provided  appropriate  pre¬ 
cautions,  which  are  discussed,  are  taken  to  ensure  that  the  model  is 
adequate,  the  estimates  of  trend  will  have  efficient  properties  and  they 
will  employ  the  data  in  a  manner  most  appropriate  to  the  particular 
series  under  study. 
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The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC,  and  not  with  the  authors  of  this  report. 


ESTIMATING  CURRENT  TREND  AND  GROWTH 
RATES  IN  SEASONAL  TIME  SERIES 


George  E.P.  Box  and  David  A.  Pierce 

1 .  INTRODUCTION 

For  dacades  Che  seasonal  adjustment  of  time  series  has  been  widely 
practiced  and  even  more  widely  discussed.  The  goal  of  such  adjustment  is 
presumably  to  facilitate  the  elucidation  and  interpretation  of  ocher  system¬ 
atic  aspects  of  the  series,  i.e.,  of  the  trend.  Thus,  in  one  sense  the 
title  of  this  paper  is  another  name  for  seasonal  adjustment.  However,  our 
approach  differs  in  several  important  respects  from  the  Census  Xll  procedure 
(Shiskin,  Young,  and  Musgrave,  1967)  and  other  traditional  approaches  to 
deseasonalization.  Most  importantly,  it  is  linked  to  building  a  model  for 
the  series,  thereby  basing  whatever  further  analysis  is  desired  on  that 
model's  established  properties;  this  aspect  is  more  fully  discussed  in 
Section  2.  A  further  point  is  that  our  focus  is  on  current  and  projected 
trend  rather  than  on  extracting  patterns  in  historical  series.  While  ex 
post  seasonal  adjustment  and  trend  estimation  are  Important  for  some  pur¬ 
poses,  the  problem  of  prime  importance  to  many  people,  including  forecasters, 
planners  and  policymakers,  is  obtaining  the  best  estimate  of  what  is  happen¬ 
ing  now.  Finally,  the  procedure  is  determined  uniquely  by  the  model  and 
thus  avoids  the  elements  of  arbitrariness  inherent  In  stochastic  modelling 
approaches  such  as  those  of  Box,  Hillmer,  and  Tiao  (1978)  and  Pierc  (1978). 

Section  2  of  the  paper  discusses  the  importance  of  model-building 
in  scientific  inquiry  and  introduces  the  time  series  models  on  which  the 
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present  investigation  is  based.  In  Section  3  these  models  are  used  to 
develop  estimates  of  trend  for  general  seasonal  series.  This  involves  an 
analysis  of  the  forecast  function  of  the  modelled  series,  expressed  as  the 
solution  of  a  difference  equation.  This  solution  contains  a  set  of  adaptive 
coefficients  (adaptive  to  the  current  time  period),  some  of  which  can  be 
associated  with  the  series'  current  trend  (or  growth  rate  for  logged  series). 

Section  4  studies  modelling  and  trend  estimation  for  the  series 
of  demand  deposits  at  commercial  banks,  a  major  component  of  the  U.S.  money 
supnlv.  Estimated  and  actual  growth  rates  are  compared  over  a  5-year  period, 
and  their  mean  square  error  is  found  to  correspond  closely  to  the  demand- 
deposit  model's  error  estimate.  Some  concluding  remarks  comprise  Section  5. 
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2.  TIME  SERIES  MODELS  AND  MODELLING  PHILOSOPHY 


Seasonal  adjustment,  trend  estimation  and  so  forth  imply  a  belief 
in  regularities  of  some  kind  in  the  series  studied.  This  "sequence  regular¬ 
ity”  is  imperfect  and  therefore  must  be  expressed  in  terms  of  probability. 
Sequence  regularity  expressed  by  probability  is  precisely  what  a  time  series 
model  is.  While  a  time  series  model  implies  a  particular  choice  of  procedure, 
a  particular  choice  of  procedure  implies  a  particular  kind  of  time  series 
model.  Thus,  it  was  shown  by  Cleveland  and  Tiao  (1976)  that  the  Xll  program 
implies  (very  nearly)  a  particular  kind  of  time  series  model  with  particular 
values  of  its  adjustable  parameters.  Let  us  call  this  model  M(X11).  Since 
Xll  was  arrived  at  by  highly  skilled  people  using  many  iterations,  M(X11)  is 
an  average  or  compromise  model  for  the  range  of  series  on  which  its  organizors 
tested  it.  Consequently,  Xll  can  be  expected  to  do  an  averagely  good  job  for 
series  whose  models  are  similar  to  M(X11)  (for  series  which  are  like  the  ones 
it  was  tested  on)  and  not  as  good  job  on  other  series.  For  example,  if  Xll 
were  applied  to  a  random  series,  it  would  Induce  seasonality  in  the  series. 

The  above  implies,  of  course,  that  models  and  methods  are  not  arbi¬ 
trary  but  can  be  built  and  applied  in  a  series  of  logical  steps.  These 
steps  have  been  set  out,  for  example,  by  Box  and  Jenkins  (1970).  Basically, 
the  argument  is  that  a  model  Is  a  transformation  of  data  to  white  noise, 
evidenced  by  residuals,  uncorrelated  with  any  other  known  input.  The  model 
building  process  is  an  iteration  which  is  guided  at  each  step  by  the  need  to 
achieve  this. 

The  conclusion  from  this  argument  is  as  follows.  Since  different 
time  series  have  different  probability  structures  (i.e.,  different  models), 
methods  of  analysis  such  as  seasonal  adjustment  methods,  trend  estimation 
methods,  etc.,  should  be  different  and  should  depend  on  the  model.  Similarly, 


seasonal  adjustment  methods,  If  they  are  really  relevant  to  the  problem,  must 
be  model-based  [as  are  those  proposed  by  Box,  Hillmer,  and  Tlao  (1978)  and 
Pierce  (1978),  and  Burman  (1980)],  so  that  they  adapt  to  the  series  under  study. 

In  any  statistical  or  scientific  investigation,  therefore,  one's 
approach  should  consist  of  two  stages: 

1)  to  build  a  model  for  the  data  under  study; 

2)  to  use  that  model  to  supply  answers  to  whatever  it  is  that 
we  want  to  know. 

This  process  is  necessarily  ongoing,  as  seldom  is  a  model  ever  ideal;  rather, 
model  building,  like  the  pursuit  of  happiness,  is  something  that  one  should 
always  be  working  on,  continually  examining  residuals  and  worrying  about 
ocher  variables. 

In  the  present  study,  we  construct  seasonal  ARIMA  models  for  time 
series  and  show  how  they  can  be  used  to  estimate  the  trend  (or  growth  rate) 
of  the  series.  While  the  various  aspects  of  a  series'  behavior  quite  likely 
result  from  forces  not  entirely  captured  by  ARIMA  models,  we  believe  that 
this  is  a  natural  place  to  begin.  Having  first  constructed  an  ARIMA  model, 
we  can  then  allow  for  outliers  or  interventions,  or  relate  two  or  more  time 
series.  The  need  for  this  more  elaborate  analysis  is  suggested  both  by  an 
examination  of  the  white  noise  residuals  —  the  sequence  of  one-step-ahead 
forecast  errors  —  and  by  economic  or  institutional  knowledge  of  any  addi¬ 
tional  variables  to  which  the  residuals  may  be  related.  The  criterion  for 
Including  the  results  of  such  an  analysis  is  whether  the  variance  of  these 
residuals  is  materially  reduced. 

An  ARIMA  model  is  a  means  for  expressing  the  current  value  zt  of  a 
time  series  in  terms  of  the  past  values  zt_i ,  Zf2 » •  •  •  chat  series.  Thus 


we  could  write 
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zt  ”  *1*1-1  +  *2*1-2  +  •  ••  +  ac  *  5>jZc_j  +  ac  (2.1) 

where  ac  is  Che  random  error  (shock,  innovation)  at  time  t  unpredictable  from 
the  series'  past,  assumed  to  be  (iid)  with  mean  0  and  variance  <p- .  If  B 
denotes  the  backshift  operator  defined  by  B^zc  *  zt-j  t^en  (2*1)  becomes 

(1  -  -  tt(B)zc  ■  ac  (2.2) 

As  this  expression  implies  a  potentially  infinite  number  of  parameters 
we  assume,  for  parsimony  and  simplicity,  that  it(B)  can  be  expressed  as 
a  ratio  ♦(B)/9(B),  whereupon  multiplying  (2.2)  through  by  9(B)  we  obtain 

♦(B)zt  =*  <KB)at.  (2.3) 

In  practice  zt  is  frequently  nonstationary  but  stationary  after  differencing 
the  series  d  times,  in  which  case 


♦(B)  -  A(B) 9(B)  (2.4) 

where  A(B)  -  (l-B)^.  If  <p( B)  and  9(B)  are  of  degrees  p  and  q  then  (2.3)  is 
referred  to  as  an  autoregressive-integrated  moving  average  (ARIMA)  model  of 
order  (p,d,q).  In  the  model  (2.3),  the  roots  of  the  characteristic  equations 
♦(B)  *  0  and  9(B)  **  0  lie  outside  the  unit  circle,  and  the  zeroes  of  the 
"differencing"  polynomial  A(B)  lie  on  the  unit  circle.  The  differenced 
series  wt  *  A(B)zt  is  therefore  a  stationary,  invertible  autoregressive- 
moving  average  processes 

p  q 

wt  »  Z  hv..i  -  Z  9-tat_-i  +  at«  (2.5) 

j-1  j-1 

In  constructing  a  model  for  an  observed  time  series  it  is  essential 


to  have  available  means  for  identification  (of  the  particular  model  form),  for 
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estimation  of  this  form,  and  for  diagnostic  checking,  or  model  criticism, 
after  fitting.  For  time  series  this  procedure  is  discussed  in  Box  and  Jenkins 
(1970,  Ch.  6-8). 
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3.  SEASONAL  MODEL  AND  TREND  ESTIMATION 


As  indicated  in  Section  2,  a  model  for  a  series  or  system  which 
captures  the  essential  features  of  that  process  may  be  used  to  provide  answers 
to  the  major  questions  of  this  investigation.  Here  we  are  interested  in  the 
use  of  a  model  fitted  to  a  time  series  to  construct  estimates  of  that  series' 
current  trend  or  rate  of  growth.  These  quantities  will  be  seen  to  depend  on 
forecasts  of  the  series'  future  values,  and  thus  this  section  begins  by  ana¬ 
lyzing  forecast  functions  for  ARIMA  models,  particular  for  seasonal  ARIMA 
models,  extending  Chapters  5  and  9  of  (Box  and  Jenkins,  1970).  We  then  pre¬ 
sent,  in  Section  3.3,  the  general  trend  estimation  procedure. 


3 .1  Forecast  Function  for  ARIMA  Models 

Given  a  segment  zt,  z£_i , . . .  of  a  time  series,  the  forecast  of  a 
future  value  zt+i  of  that  series  with  minimum  mean  square  error  is  the  con¬ 
ditional  expectation 

z  £  (  2 )  *  Et( z ^ )  *  E ( z £ lzt,  z£_^,...).  (3.1) 

For  the  model  (2.3)  this  forecast  function  (considered  as  a  function  of  2, 
the  "lead  time")  is  known  to  satisfy  the  difference  equation 

$(B)zt(JS)  -  0(B)at(2)  (3.2) 


where  B  now  operates  on  2,  and 


In  particular, 


at(2) 


at+2  >  A  <  ® 

0,  2  >  0. 


$(R)  zt(  2)  =*  0  ,  2  >  q  . 


(3.3) 
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For  l  >  q  -  P,  eq.  (3.2)  has  a  general  solution  of  the  form 

P 

zt(Jt>  -  Z  bJ^fjd),  (3.4) 

i-1 

where  the  fj(2),  1  i  £  P,  are  functions  (in  general  polynomials,  exponen¬ 
tials,  sines  and  cosines  and  products  of  these)  of  the  lead  time  2.;  in 
particular,  f^(2)  »  g^  if  the  root  of  $(B)  *  0  is  real  and  distinct. 

Having  determined  the  functions  f] _(2),  the  solution  (3.4)  further 
requires  a  knowledge  of  the  adaptive  coefficients  b^c\...,  b^) ,  so  named 
because  they  change  with  the  forecast  origin  t,  adapting  to  new  information 
(data)  continually  becoming  available.  In  Appendix  1  it  is  shown,  in  turn, 
how  to  obtain  the  {b£c^  }  : 

(a)  from  an  initial  set  of  forecasts, 

(b)  directly  from  the  available  observations  {zt,  zt_^,...j, 

(c)  from  their  previous  values  as  additional  observations 
become  available  and  the  forecast  origin  Is  shifted 
forward . 

3 .2  Seasonal  ARIMA  Models 

An  important  case  of  the  ARIMA  model  (2.3)  found  useful  in  analyzing 
seasonal  time  series,  which  exhibit  periodic  behavior  of  a  stochastic  or  adap¬ 
tive  nature,  is  the  multiplicative  seasonal  model.  Suppose  that  in  (2.3)  the 
operators  $(B)  and  3(B)  factor  according  to 

•(B)  -  •1(B)«2(Bs) 


6(B)  -  el(R)82(Bs) 


O  - 


where  the  seasonal  operators  $ 2  and  92  are  functions  of  Bs ,  s  denoting  the 
period  (e.g.,  s”12  for  monthly  data  with  an  annual  seasonal  pattern).  Then 
the  model  (2.3)  may  be  written 

f1(B)<J2(Bs)zc  =  91(B)92(Bs)ac.  (3.5) 

A  simple  example  of  a  seasonal  ARIMA  model  would  be 


zt  “  zt-12  +  at  “  ^t-l  > 
or 

(1  -  B12)zt  -  (1  -  9B)at, 

in  which  $2(B)  -  1  -  B12  ,  9(B)  -  1  -  9B,  and  $X(B)  =*  92(B)  =»  1.  This  model 
expresses  the  current  observation  as  the  sum  of  last  year's  value  and  a  linear 
combination  of  this  and  last  month's  shocks. 

Typically  $1  and  9^  will  be  of  low  order.  As  in  (2.3),  i>|(B) 
incorporates  nonseasonal  differencing  operators  applied  to  render  the  series 
stationary.  For  example,  the  model  fitted  to  the  Demand  Deposit  series  in 
Section  4  is  of  the  form 


(1  -  B) ( 1  -  B12)zt  =  (1  -  9B) ( 1  -  9B12)  (3.6) 

and  has  [noting  1  -  B^  *  (1  -  B)(l  +  B  +  ...  +  B^)] 

11  . 

<t>1  (B)  -  (1  -  B)2,  *2(B)  -  "  BJ.  (3.7) 

j=0 


3 .3  Estimated  Trend 

The  general  procedure  for  trend  estimation  for  a  seasonal  time 
series  can  now  be  set  forth.  In  the  seasonal  ARIMA  model  (3.5),  if  ,  J>-> , 

9|  and  92  are  respectively  of  degrees  ,  ?2 »  dl  an^  <12  then  analogous 

to  equation  (3.4)  the  eventual  forecast  function  for  the  model  (3.5)  may  be 


written  in  the  form 


in  - 


2 t(*)  -  I  b[j>  fu(i)  +  Z  b£f>  f21(  t) 

1-1  1-1 

-  Tt(t)  +  St(*)  (3.8) 

The  second  sum  on  the  right  hand  side  of  (3.8)  is  associated  with 
the  seasonal  par*-  of  the  model,  determined  by  $ 2  and  92 .  The  first  sum  Tt(£) 
embodies  all  systematic  nonseasonal  influences,  and  may  thus  be  regarded  as 
the  crend.  Our  proposed  trend  estimate  for  seasonal  time  series  described 
by  the  model  (3.5)  is  therefore 

P 

1 

Tt(«  -  zAl)  -  S  (1)  -  Z  b{£>  f  (*)  (3.9) 

i-1 

The  quantity  Tt(£),  which  incorporates  anything  systematic  and 
nonseasonal  that  is  known  about  the  series  at  the  current  time  t,  will  often 
correspond  well  to  our  instinctive  notion  of  trend.  For  example  if  ^(B) 
contains  a  factor  (1  -  B)^  reflecting  a  nonstationarity  removed  by  differenc¬ 
ing  the  serit..  d  times,  then  Tt(£)  contains  a  polynomial  of  degree  d-1  (in 
i) ,  with  coefficients  bj^  adapting  with  the  origin  t.  Thus  if  d  is  greater 
than  1  (equal  to  or  greater  than  1  if  a  constant  term  also  appears  in  the 
expression  for  (1  -  B)zt)  then  at  least  a  linear  trend  will  be  incorporated 
into  Tt(£).  On  the  other  hand,  we  would  not  ordinarily  think  of  a  series 
zt  which  is  already  stationary  as  possessing  a  trend,  and  indeed  Tt(£)  for 
such  a  series  would  either  be  zero  or  possess  only  damped  terms  based  on  the 
roots  of  the  stationary  autoregressive  operator  d>( B ) . 

Similar  statements  can  be  made  about  S t (  2.) ;  for  example,  whenever 
is  a  factor  of  $2(R),  S t(  i)  will  include  a  periodic  function  of  period 
s;  this  is  the  case  for  the  model  (3.6). 
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4.  ANALYSIS  OF  DEMAND  DEPOSIT  SERIES 
The  U.S.  Money  Supply  is  a  closely  watched  and  much  investigated 
series  in  economic  policy  making  and  analysis.  Changes  in  the  underlying 
behavior  of  this  series  have  an  immediate  impact  on  financial  markets  and 
are  felt  to  have  a  strong  association  with  many  measures  of  economic  activity, 
including  income,  inflation  and  employment.  It  is  therefore  of  prime  impor¬ 
tance  for  both  the  Federal  Reserve  Board  and  the  public  to  have  available  the 
best  and  most  timely  information  possible  on  the  current  behavior  of  this 
series,  i.e.,  its  current  trend  or  rate  of  growth.  A  key  element  of  the 
money  supply  is  its  demand-deposit  component,  and  thi9  section  is  devoted  to 
estimating  the  current  rate  of  growth  of  this  series. 

4 . 1  Airline  Model 

The  model  fitted  to  the  Demand  Deposit  series  (Section  4.2)  is  of 
the  general  form  (3.6),  which  has  been  found  to  describe  quite  well  a  number 
of  seasonal  time  series.  It  was  first  fitted  by  Box  and  Jenkins  (Chapter  9)  to 
a  series  of  logged  monthly  passenger  totals  in  international  air  travel  and 
has  thus  become  known  as  the  Airline  model.  This  model  has  a  forecast  func- 
tio  zt(l)  satisfying  the  difference  equation 

(1  -  B) ( 1  -  B12)zt(Z)  -  (1  -  0B)(1  -  0B12)at(O  (4.1) 

where  at(£)  is  as  below  (3.2).  This  equation  has  a  solution  which  can  be 
expressed  in  several  equivalent  forms,  involving  dummy  variables  or  sines  and 
cosines  for  the  seasonal  term  St(£)  in  (3.8).  These  are  derived  in  part  by 
Box  and  Jenkins  (1970)  and  in  part  in  Appendix  2,  where  it  is  found  that  the 
most  appropriate  expression  for  our  current  use  is  of  the  form 


zt(£)  -  b£c)  +  b^c)  +  b(t)i  . 


(4.2) 
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The  three  terms  on  the  right  hand  side  of  (4.2)  are  respectively  the  level, 
seasonal  and  slope  components  of  the  forecast.  Therefore  the  estimated 
trend  is,  as  in  (3.9), 

TtU)  -  z t(»)  -  b<c)  =  b +  b (c)l  (4.3) 

where  in  (4.2)  and  (4.3)  m  »  1,2,.  .,12  indexes  the  month  of  the  year  in  which 
the  value  zt+jj  falls.  There  are  thus  14  coefficients  (b£ , . . .  ,bjrJp  ,b(c)  > 
b^c^)  the  first  12  of  which  satisfy  the  constraint  £  b^c^  ■  0.  As  with  the 
coefficients  in  nonseasonal  ARIMA  models  these  may  also  be  determined  in  several 
ways,  as  illustrated  in  Appendix  2.  In  particular  the  following  results  are 
of  primary  interest: 

1.  The  slope  coefficient  b^  in  (4.2)  is  given  by 

b(c)  -  fzt(13)  -  zc(l)]/12,  (4.4) 

which  is,  as  perhaps  expected,  the  average  monthly  increment  to  the  forecasts. 
The  other  b-coef f icients  are  similarly  determined  from  the  forecasts  zt(l ),..., 
zc(13). 

2.  The  b’s  are  linear  combinations  of  forecasts  which  are  them¬ 
selves  linear  combinations  of  the  data  zt,  zt_i .  Thus  the  coefficients 

b,  bQ,  .  b^2  are  expressable  directly  in  terms  of  this  available  data, 

as 

b£c)  -  W1(B)zt.  (4.5) 

For  example,  Figure  1  shows  the  weights  |Wj }  in  determining  the  slope 

b(c)  -  W(B)zt  -  (4.6) 


for  the  Airline  data  referred  to  above. 
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3.  The  coefficients  of  the  forecast  function  evolve  as  new  obser¬ 
vations  result  in  a  shifting  forward  of  the  forecast  origin,  t;  for  example, 
the  relation 

b(c+1)  =  b<c)  +  (1  -  9) ( 1  -  0)at+1  (4.7) 

shows  how  a  fraction  of  the  new  information  (innovation,  shock)  at+i  is  incor¬ 
porated  into  the  revised  slope  estimate. 

4 . 2  ARIMA  Model  for  Demand  Deposit  Series 

Monthly  observations  on  the  demand-deposit  component  of  the  money 
supply  (DD)  were  obtained  for  the  period  1/69  -  1/78  (Source:  Federal  Reserve 
Bulletin.  The  data  are  periodically  revised,  the  series  here  used  being  as 
of  10/78).  Application  of  the  usual  model  fitting  procedure  (Box  and  Jenkins. 
1970,  Ch.  6-8)  to  the  logged  series  (zt  ■  log  DDt)  yielded  a  fitted  ARIMA 
model  of  the  form 

AA17zt  =*  (1  -  -6B12 )( 1  +  .lB)at  (4.8) 

with  oa  ■  .0058.  This  is  the  Airline  model  form,  with  parameter  estimates 
9  =  .6,  9  =  -.1,  so  that  the  trend  in  the  logged  demand  deposit  series  can  be 
estimated  as  in  Section  3.3.  We  shall  focus  on  the  first  difference  of  this 
trend,  which  is  the  estimated  rate  of  growth  (deseasonalized  or  seasonally 
adjusted)  of  demand  deposits.  It  is  in  fact  the  rates  of  growth  of  money 
supply  series  which  are  most  often  examined  both  within  the  Federal  Reserve 
and  in  financial  communities. 

4 .3  Estimated  Rate  of  Growth 

Taking  the  first  difference  of  the  trend  function  (4.3)  shows  that 
the  estimated  current  (at  time  origin  t)  rate  of  growth  of  demand  deposits  is 
simply  the  slope  coefficient  b^c\  Thus,  by  virtue  of  eg.  (4.4)  the  practical 
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application  of  che  concepts  herln  proposed  reduces  In  this  case  simply  to 
computing  the  difference  between  the  lead-13  and  lead-1  forecasts  of  log  DD. 

As  It  Is  customary  to  express  these  figures  in  terms  of  annual  rates,  we 
omit  the  division  by  12. 

Figure  2  shows  the  weights  which  can  be  used  to  calculate 
from  the  series  values  zt,  as  In  equation  (4.6)  (without  the  divi¬ 

sion  by  12  in  (A2.ll)).  This  is  broadly  similar  to  Figure  1  for  the  airline 
data,  differences  resulting  from  che  first  order  MA  parameter. 

The  calculation  of  the  estimated  growth  rate  b(c)  for  DD  was  made 
over  the  period  8/72  -  9/78,  and  the  results  are  shown  in  Table  1  and  Figure  3. 

4.4  Error  Limits  of  Growth-Rate  Estimates 

Since  the  slope  estimate  b^c^  and  the  other  coefficients  b^c^  are 
functions  of  the  forecasts,  the  errors  in  these  adaptive  coefficients  are  the 
corresponding  functions  of  the  forecast  errors  et( 2)  »  Zp+t  “  zt(2).  In  par¬ 
ticular  the  error  corresponding  to  b^c^  in  (4.4)  is 

e(t)  -  [et(13)  -  ec(l)] 

“  [  at+13  +  ^  at+12  +  •••  +  'h.l  at+2 

+  (*  “  1)  at+1]  (4.9) 

12 

with  mean  square 

11 

o2 [eCc> ]  -  [£0  ^  +  (4^2  -  l)2]*  (4.10) 

Letting  the  actual  growth  rates  be  defined  by 

0(0  "  zt+13  -  zt+l 

also  gives 


e( t)  *  b( c)  -  • 
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Table  1  and  Figure  3  display  these  actual  growth  rates  and 

errors  e(c).  The  dotted  lines  in  Figure  3  are  standard  error  limits  ±  e(c) 
associated  with  the  estimated  rates  of  change.  Based  on  (4.10)  we  have 

Etb<c>  -  8<c>!2  -  .00040,  (4.11) 

making  the  standard  error  .020  or  2%.  (Recall  that  these  are  annualized 
figures;  the  monthly  standard  error  itself  is  (l/12)th  of  this  amount.)  This 
mean  square  error  was  obtained  from  the  fitted  model  (4.8),  and  indeed  one  of 
the  virtues  of  the  model  building  approach  is  that  such  internal  error  limits 
are  thereby  available.  But  it  is  also  of  interest  that  the  empirical  MSE 
over  this  period, 

l_T[b(t)  -  b(c>]2  -  .00044,  (4.12) 

61 

is  in  close  agreement  with  the  model-based  estimate. 

Figure  3  also  illustrates  the  limitations  of  the  present  model  and 
the  importance  of  making  the  model  building  effort  an  ongoing  one,  to  incor¬ 
porate  additional  relevant  information.  To  give  an  estimate  of  (say)  6%  as 
the  current  seasonally  adjusted  rate  of  increase  of  demand  deposits  but  to 
have  the  95%  confidence  interval  span  the  range  2  to  10%  is  uncomfortable, 
even  though  other  money  supply  estimates/forecasts  typically  have  errors  of 
comparable  magnitudes  [e.g.,  Porter  et  al.  (1978),  Pierce  et.  al.  (1981)]. 

Ths  use  of  other  variables  related  to  causes  of  the  shortfall  of  money  growth 
during  1974  (relative  to  its  estimate  in  Figure  3)  or  of  the  overshooting  of 
money  growth  in  1976-77  could  possibly  reduce  this  error. 


5.  CONCLUSIONS 


We  have  presented  a  method  for  estimating  the  current  trend  or  rate 
of  growth  of  seasonal  time  series,  based  on  models  for  those  series,  and  have 
illustrated  its  application  with  the  demand  deposit  component  of  the  U.S. 
Money  Supply.  The  resulting  trend  estimates  are  thus  derived  in  an  optimal 
manner  from  the  underlying  characteristics  of  the  series  and  consequently  do 
not  suffer  from  the  arbitrariness  inherent  in  methods  not  so  derived.  But  we 
have  also  noted  the  need  to  regard  such  model  building  investigations  as 
ongoing  pursuits;  in  particular,  the  incorporation  of  outliers,  interventions 
and  other  variables  into  the  model  should  reduce  the  mean  square  error  of 
the  resulting  trend  or  growth-rate  estimates. 
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APPENDIX  1.  ADAPTIVE  COEFFICIENTS  IN  ARIMA  FORECASTS 
AND  TREND  ESTIMATES 

A.l  Determlnaclon  of  Adapclve  Coefficients  Iron)  Initial  Forecasts 

For  lead  times  2  >  q,  Che  forecast  function  zt(2)  satisfies  the 
homogenous  difference  equation  (3.3),  and  thus  for  such  2  (3.4)  holds  for 
arbitrary  constants  b^1^.  These  constants  are  determined  (uniquely)  by  a 
set  of  initial  conditions  which  are  equivalent  to  assuming  that  (3.4)  [though 
not  (3.3)]  also  holds  for  2  =*  q-P+1 ,  . ..,  q-1 ,  q,  which,  given  zt( 2)  for 
these  2  values  (zt(2)  =  zt+j  if  t  <  0],  defines  a  sec  of  P  equations  in  the 
P  unknowns  b£c\  ...,  b£c),  In  fact,  any  set  of  P  consecutive  forecasts/ 
actuals 

2(2)  -  [zt(£),  zt( 2)+l ) ,  ...,  zt( 2+P-l ) ] "  (Al.l) 


such  that  2  >  q-P  can  be  used.  Letting 


b(t)  -  fb<c)  ,...,  b^c'] 


(t) 


and 


fz  -  rfL(2) 


fp(  2) 


fX( 2+P-l) 


fp( 2+P-l) 


(A1.2) 


this  system  can  be  written  in  the  form 


zt(2)  =  Fjb^c\ 


whence 


b<‘> 


(AI.3) 


(  A 1  . 4 ) 
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I f  q  <_  P ,  it  is  often  convenient  to  consider  the  system  in  terms  of  che  first 
P  forecasts  (l  =*  1),  so  that,  with  z^'1  =  zc> 


b(c)  =*  F^1  z t • 


(A1.5) 


As  an  example,  consider  the  AR(1)  process 


for  which  (3.4)  is 


so  that 


(1  -  6B)xt  =  ac 


zt(  £)  =  f(i)  b(c)  =  l  >  0, 


and  the  calculation  (Al.4), 


F?  -  f(t)  -  , 


b(c)  =  (6*rl  zt( e)  =  zt, 


can  be  made  for  any  £.  >  q-P  =  -1  . 


Al • 2  Adaptive  Coefficients  in  Terms  of  the  Observed  Series 

Since  the  coefficients  b(c^  are  linear  combinations  of  an  initial 
set  of  forecasts  [Eq.  (Al.4)],  and  since  the  forecasts  at  origin  t  are  linear 
combinations  of  the  series  Jzt,  zt_i  , . . .  [  (Whittle,  1963,  Box  and  Jenkins, 
1970),  it  follows  that  the  coefficients  are  expressable  as  linear  combinations 
of  the  series.  In  particular,  writing 


zt(  O 


*U)(B)zt, 


(Al .6) 


it  follows  that 


*(l)(B) 


<B)[  2  Hi.B-J-*], 

j»  l  J 


(Al .7) 
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where 

ao 

ir(B)  -  I  TTjB J  -  ijT 1  ( B )  -  (  E 

O 

Hence,  if 

tt(*)(B)  -  (A1.8) 

Chen  from  (A1.4)  and  (A1.6),  the  desired  expression  for  the  coefficients  is 


b(c)  -  W(B)zt 


(A1.9) 


where 

W(B)  -  F*1  it(4)(B)  -  [Wj_(B) . WpCB)]'  •  (A1.10) 

Of  course  the  weights  W(B)  are  the  same  for  any  value  of  i  >  q-P  in  (Al.10). 
For  the  AR(1)  process  introduced  at  the  end  of  Section  3.1, 


ir<1>(B)  =  W(B)  5  1. 


A1 .3  Updating 

Given  a  new  observation  z^+l*  che  forecasts  from  origin  t+1  may  be 
expressed  as  simple  adjustments  to  the  forecasts  calculated  at  origin  t,  the 
adjustments  depending  on  (and  only  on)  the  new  information  at+]_.  Thus  the 
adaptive  coefficients  may  be  so  updated.  In  particular,  the  usual  updating 
formula 

zc+i(*>  *  zt(i+l)  +  <| >i  at+1 

is.  In  the  previous  notation, 


■(l+l) 

lx 


+  *%  at+l’ 


(Al.ll) 


with  i  •  •  • » )  >  so  Chat,  from  (A1.3)  and  its  counterpart 


at  time  c+1 , 
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F2  bU+l)  =  ^2+lb(C) 


Vt+1 


(A1.12) 


whence 


u(  t+l  )  a  p“*l  p  w(t)  X  p“"l  X  a 

b  F2  F2+lb  +  f2  Vt+1 


L  bV  +  k 


*t+l  ‘ 


(A1.13) 


Again  considering  the  AR(1)  process  at  the  end  of  Section  3.1, 
(Al.13)  becomes,  taking  l  »  0  so  that  F0  =  1  and  F|  =»  <)>, 

b(c+l)  ,  *b(t>  +  St+i 

which,  since  b^c^  =*  zt,  is  simply  the  equation  for  the  process. 

A1 .4  "Error"  of  Adaptive  Coefficient  Estimates 

Since  the  various  b^^'s  are  functions  of  the  forecasts,  the  errors 
in  these  adaptive  coefficients  may  be  defined  as  the  corresponding  functions 
of  the  forecast  errors.  In  general, 


e(b 


(O,  =  F-l  AD 


,(t)  _  h(t) 


CAl .14) 


where,  analogous  to  (A1.4), 

B^  ^  )  •  ( Al .  1  5 ) 


Mote  that  and  e[h(c)],  unlike  b^)  itself,  depend  on  the  value  of  l. 


* 
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APPENDIX  2:  AIRLINE  MODEL  TREND  ESTIMATION 


The  solution  of  the  forecast  function  (A. I)  for  the  airline  model 
(3.6)  is  of  the  form 


*tU) 


2irj  l 

sin  - ]  . 

12 


An  equivalent  form,  which  is  easier  to  work  with,  uses  monthly  dummy  or  indi¬ 
cator  variables,  and  there  are  several  variants.  Adapting  the  development  in 
[Box  and  Jenkins  (1970),  p.  309],  it  can  be  shown  that  (A2.1)  can  be  written 
in  the  alternative  form 


zr(l)  - 
t x  om 


(A2.2) 


where  l  is  measured  in  months. 

Next,  note  that  the  monthly  coefficient  incorporates  both 

an  overall  level  effect 


12 


blc)  -  _1  E 


12  m-i 


om 


(A2.3) 


and  a  seasonal  effect  specific  to  the  m1-"  month 


biC)  ”  hom5  "  bot>; 


(A2.4) 


thus,  the  forecast  (A2.2)  is  equivalently  equation  (4.2)  of  the  text,  from 
which  the  trend  (4.3)  is  derived. 

Parallel  to  Appendix  1  we  examine  each  group  of  coefficients,  obtain¬ 
ing  expressions  for  them  (a)  from  an  initial  set  of  forecasts,  (b)  from  the 
available  observations  zt,  zt_^,...,  and  (c)  from  their  previous  values  as  new 
observations  become  available  and  the  origin  is  shifted  forward. 
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A2 . 1  Initial  Determination  of  Adaptive  Coefficients 

As  in  (Al.l)  let  z£^  denote  the  vector  of  P“13  forecasts  zt(!.), 

■  zc(S.+12),  and  for  convenience  let  us  take  l  »  I ,  letting  z£^  *  zt, 

chough  any  positive  l  would  suffice.  Then  (A1.3)  is  a  system  of  13  equations 

of  the  form  (A2.2)  which  needs  to  be  solved  for  the  13  unknowns  »<E> . 

bo^2  •  b<°-  Tbls  is  most  immediately  done  by  noting  that  the  equations 
for  zt(l)  and  zt(13)  imply  that  the  slope  coefficient  is  equation  (A. 4)  of 
the  c ext. 

In  terms  of  b^c^  the  other  12  equations  then  each  have  solutions 

“  it(«)  “  ®  b^  (A2.5) 

giving  the  mcb  monthly  coefficient  as  an  adjustment  to  the  lead-m  forecast, 
the  correction  being  the  amount  required  to  offset  the  trend  component  of 
the  forecast. 

Given  (4.4)  and  (A2.5),  the  level  and  seasonal  effect  coefficients 
b^c^  and  b^c^  In  (4.2)  are  determined  as  in  equations  (A2.3)  and  (A2.4): 

12 

b<c)  -  J-  Z  z  (m)  -  11  [£-(13)  -  zt(l)],  (A2.6) 

°  12  m=*l  C  24  c  c 

12 

b£c)  -  z t(m)  -  -I  Z  zt(n)  +  13  -  -2H  [£  (13)  -  zt(l)]  .  (A2.7) 

m  C  12  n»!  C  24  c  c 

A2 .2  Adaptive  Coefficients  in  Terms  of  Available  Data 

As  in  Appendix  1,  the  various  adaptive  coefficients  are  each  expres- 
sable  as  linear  combinations  of  the  observed  series  zc,  zc_^,...  .  Considering 
first  the  forecasts  written  as  in  (A2.2)  containing  12  monthly  levels  b^p , 

Let 

bom^  *  Wom^B^zc’  “"I.---.  12  (A2.8) 
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Then  from  (A1.6)  and  (A2.5), 

Wom(B)  "  “  -j|  [w(13)(B>  -  n(1)(B)];  (A2.9) 

and  writing  the  slope  coefficient  as 

b(c)  =  W(B)zt  (A2.10) 

which  is  eq .  (4.6)  of  the  text,  it  follows  that 


W(B)  -  _L  [it(13)(B)  -  x(l)(B)].  (A2.ll) 

12 

Let  us  next  express  the  forecast  function  as  (4.2),  in  which  the  monthly 

level  is  separated  into  an  overall  level  and  a  seasonal  effect  b^c^ 

o  m 

(r^L  b£c>  -  0).  From  (A2.6)  and  (A2.7),  if 


then 


Vm(B)zt,  tn»0 , 1 , . . . ,  12 


(A2.12) 


VB>  "  TT  S  WomW 


12 

-  _L  Z  x(ffl)(B)  -  11  [  ttO-3  )  (B)  -  *(1)(B)] 
12  m-i  24 


(A2.13) 


and 


Wm(B)  -  Wom(B)  -  W0(B),  m-l,...,12 

12 

-  ir(m)(B)  -  _L  Z  x(«)(B)  +  13  ~  2m  [x<13)(B)  -  irO)(B)].  (A2.14) 

12  24 


Whereas  the  transformation  from  the  forecasts  zt  to  the  adaptive 
coefficients  b(c)  does  not  depend  on  the  airline-model  parameters  (as  the 
form  of  eventual  forecast  function  does  not),  the  forecasts  themselves, 
and  thus  the  weights  such  as  W(B)  and  Wm(B),  are  functions  of  9  and  9. 


28  - 


These  weights  functions  can  be  determined  for  Lhe  values  9  *  .4  and  0  *  .6, 
corresponding  to  the  least  squares  fit  obtained  by  BJ  for  the  airline  data. 

Using  numerical  recursive  calculations,  we  first  determine 

rr(B)  =  <T1(B) 

-  (1-B)  (1-B12)  (1-.4B)-1  (1-.6B12)"1  (A2.15) 

truncated  at  order  256,  and  then  for  i  m  1 , . . . ,  13  is  obtained  as  in 

(Al.7).  Next  we  form  the  various  weight  functions,  including  W(B)  which  was 
plotted  in  Figure  1.  Note  the  periodicity  exhibited  by  this  weight  function, 
which  was  true  of  the  others  as  well. 


A2 .3  Updating 

As  discussed  in  A1.3,  the  coefficients  of  the  forecast  function 
(3.4)  evolve  as  new  observations  result  in  a  shifting  forward  of  the  forecast 
origin.  The  basic  formula  for  the  calculation  is  equation  (Al.13),  with  P=*13. 
However,  it  is  easier  to  work  directly  with  the  airline  model  form,  adapting 
the  development  in  [Box  and  Jenkins  (1970),  pp.  310-11]  to  the  modified  form 
(A2.2)  of  the  forecast  function. 

Letting 

X  =  1  -  9,  A  -  1  -  0, 


and  letting  l  *  12r  +  m,  1  _<  m  <_  12,  then 


*>1  *  'J'IZr+m  ’  HI  +  rA)  +  6i2m 

where  5|2m  *  1  Iff  m  *  12  and  0  otherwise.  From  (A2.16)  and  the  updating 
formula  (Al.13),  It  can  be  shown  that 

b(t+1)  -  b<c>  +  (XA/12)ac+1 , 

b«+1)  ■  »o!in  * b<t>  +  + 


(A2.16) 


(A2.17) 

(A2. 18) 
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where,  if  n  ■  12,  *s  replaced  by  b^-*. 

Thus  the  previously  forecasted  series  level  for  each  month  is 
adjusted  by  the  previously  forecasted  increment  to  the  trend,  now  incorporated 
into  the  level  at  the  new  origin;  and  all  the  coefficients  are  adjusted  by 
varying  fractions  of  the  new  information  (innovation,  shock)  • 

For  the  airline  model  coefficients  \  ■  .6  and  A  •  .4,  (A2.17)  and 
(A2.18)  become 


,(t+L)  .  v(t) 


+  .02  a 


t+1 


b£m+1)  -  +  b(C>  + 

om  o ,  orri 


(.6  -  .02m)  at+i ,  m  +  12 
.76  at+i ,  m  m  12 


The  seasonal  effects  b^c^  and  the  level  effect  b^c^  in  (4.2)  are 
updated  in  corresponding  ways,  based  on  (A2.3)  and  (A2.4).  Thus, 


boC+1)  *  boC)  +  b(t)  +  ( X<1  -  II  A)  +  A]  at+1,  (A2.19) 


\ 


since  (Em)/144  »  13/24  and  £5].2m  *  1»  and 

bit+1)  “  b4+i  +  I  U  "  (1  "  512m^  at+l 


by  subtracting  (A2.19)  from  (A2.18).  For  \  ”  .6,  A  -  .4 
h(t+l)  m  b(t)  +  b^c^  +  .87  at+^ 


b(c+l) 

m 


[.01  (13  -  2m)  -  .4]  at+1,  m  t  12 

-.11  at+x ,  m  -  12 


Table  A2.1  gives  the  updating  coefficients  for  b  and  b  for  this  fitted 

°  om  m 


airline  model. 


( 
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Table  A2.1 

Coefficient  of  a^.+^  in  Updating  Formulae  for  Fitted  Airline  Model 


m 

i 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

* 

(t+1) 

b 

om 

.58 

.56 

.54 

.52 

.50 

.48 

.46 

.44 

.42 

.40 

.38 

.76 

.02£/ 

(c+l) 

b 

m 

-.29 

-.31 

-.33 

-.35 

-.37 

-.39 

-.41 

-.43 

-.45 

-.47 

-.49 

-.11 

.8  7.k/ 

,  (t+1) 

a /  Slope  b 

#  (t+D 

b /  Intercept  b 


31  - 


REFERENCES 


Box,  George  E.P.,  S.C.  Hillmer,  and  George  C.  Tiao  (1978),  "Analysis 
and  Modelling  of  Seasonal  Time  Series,"  in  A.  Zellner  ( ed . ) , 
Seasonal  Analysis  of  Economic  Time  Series,  Washington,  D.C.: 

U.S.  Bureau  of  the  Census,  pp.  309-334. 

Box,  George  E.P.  and  Gwilym  M.  Jenkins  (1978),  Time  Series  Analysis, 
Forecasting  and  Control,  San  Francisco,  Holden-Day  (Revised  Ed., 
1976). 

Burtnan,  J.P.  (1980),  "Seasonal  Adjustment  by  Signal  Extraction," 

Journal  of  the  Royal  Statistical  Society  (Ser.  B) ,  42,  forth¬ 
coming  . 

Cleveland,  William  P.  and  George  C.  Tiao  (1976),  "Decomposition  of 
Seasonal  Time  Series:  A  Model  for  the  Census  X-ll  Program," 
Journal  of  the  American  Statistical  Association,  71,  (September), 
pp.  581-587. 

Pierce,  David  A.  (1976),  "Seasonal  Adjustment  When  Both  Deterministic 
and  Stochastic  Seasonality  are  Present,"  in  A.  Zellner  (ed.), 
Seasonal  Analysis  of  Economic  Time  Series,  Washington,  D.C.: 

U.S.  Bureau  of  the  Census,  pp.  242-273. 

Pierce,  David  A.,  Darrel  W.  Parke,  William  P.  Cleveland,  and  Agustin 
Maravall  (1981),  "Uncertainty  in  the  Monetary  Aggregates: 

Sources,  Measurement  and  Policy  Effects,"  Journal  of  Finance, 
forthcoming. 

Porter,  Richard  D. ,  Agustin  Maravall,  Darrel  W.  Parke  and  David  A. 

Pierce  (1978),  "Transitory  Variations  in  the  Monetary  Aggregates, 
Improving  the  Monetary  Aggregates,  Washington,  D.C.:  Board  of 
Governors  of  the  Federal  Reserve  System,  pp.  1-34. 

Shiskin,  Julius,  Allan  H.  Young,  and  John  C.  Musgrave  (1976),  "The 
X-ll  Variant  of  the  Census  Method-II  Adjustment  Program," 
Technical  Paper  No.  15,  U.S.  Bureau  of  the  Census  (February). 


ECllR.  y  CL  *SS1  Flv.  ATIOI.  OF  "h  P^OE  (HTien  Date  Fntered 


REPORT  DOCUMENTATION  PAGE 


RLPORT  NUMBER 


4.  T|  TLE  (end  Subtitle) 


i2.  GOVT  ACCESSION  NO 


ESTIMATING  CURRENT  TREND  AND  GROWTH  RATES  IN 
SEASONAL  TIME  SERIES 


Rf.AV  INSTRUCTIONS 
BFKORK  COVI’l.KTINT.  Kl'KM 


3  RECIPIENT’S  CAT  M.OG  N  I;  M  II  f  ■> 


S.  Type  of  report  &  period  covered 

Summary  Report  -  do  specific 
reporting  period 


6.  PERFORMING  ORG.  REPORT  NUMUER 


.  AUTHOR!*) 


George  E.P.  Box  and  David  A.  Pierce 


e.  CONTRACT  OR  GRANT  NUMBERfi/ 


DAAG2  9- 80-C-0041 


9.  performing  organization  name  and  address 

Mathematics  Research  Center,  University  of 
610  Walnut  Street  Wisconsin 

Madison,  Wisconsin  53706 


II.  controlling  office  name  and  address 

U.  S.  Army  Research  Office 
P.O.  Box  12211 

Research  Triangle  Park,  North  Carolina  27709 _ 


4.  MONITORING  AGENCY  NAME  6  ADDRESS(/f  different  from  Controlling  Office) 


16.  DISTR  8UTION  STATEMENT  (of  thit  Report) 

Approved  for  public  release;  distribution  unlimited. 


17.  DISTRIBUTION  STATEMENT  (of  the  abstract  entered  in  Block  20,  it  different  from  Report) 


10.  PROGRAM  ELEMENT.  PROJECT.  T  ASK 
AREA  6  WORK  UNIT  NUMBERS 

Work  Unit  Number  4  - 
Statistics  and  Probability 


12.  REPORT  DATE 

May  1981 


13.  NUMBER  OF  PAGES 


15.  SECURITY  CLASS,  (of  thla  report) 


UNCLASSIFIED 


J5«.  OECLASSlF!  CATION  DOWNGRADING 
SCHEDULE 


13-  KEY  WORDS  ( Continue  on  reveree  eide  if  neceeeery  mxd  Identify  by  block  number) 

Seasonal  Adjustment,  Trend  Estimation,  Time  Series  Models, 
Adaptive  Estimation 


20.  ABSTRACT  (Continue  on  reveree  aide  If  neceeeery  end  Identify  by  block  number) 

The  importance  of  appropriate  stochastic  models  in  choosing  efficient 
methods  of  statistical  analysis  is  discussed.  The  fitting  to  data  of 
Seasonal  Autoregressive  Moving  Average  models  is  described  and  it  is  shown 
how  trend  may  be  estimated  in  an  appropriate  class  of  models  of  this  kind. 
The  procedure  is  illustrated  for  a  model  fitted  to  a  money  supply  series 
published  by  the  Federal  Reserve  Board.  Error  limits  are  calculated. 

1  a  series  of  Appendices  the  properties  of  the  adaptive  coefficients 
which  determine  the  trend  estimates  are  derived. 


EDITION  OF  I  NOV  SS  IS  OBSOLETE 


UNCLASSIFIED 

SECURITY  CLASSIFICATION  OF  THIS  PAGE  (l*Tl»n  Dm tm  Entmrmd) 


